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SYSTEM AND METHOD FOR DEINTERLACING A VIDEO SIGNAL FOR 
DISPLAY ON PROGRESSIVE DISPLAY DEVICES 



5 NOTICE OF COPYRIGHT 

A portion of the disclosure of this patent document contains material which is 
subject to copyright protection. The copyright owner has no objection to the facsimile 
reproduction by anyone of the patent document or the patent disclosure, as it appears in 
the Patent and Trademark Office patent files or records, but otherwise reserves all 
1 0 copyright rights whatsoever. 

FIELD OF THE INVENTION 

The present invention generally relates to digital media players and, more 
particularly, to a system and method for detecting interlaced video signals and processing 
15 such signals to make them viewable on progressive display devices. 

BACKGROUND OF THE INVENTION 

Conventional video signals provided from a standard television camera (NTSC 
signal) or a standard video camera are comprised of a series of frames. Each frame is 

20 comprised of two fields (top and bottom) having opposite polarity. Each field contains a 
series of pixels that contain data representative of the image present in each frame. The 
frames are interlaced in such a fashion that the top and bottom fields are configured either 
in sequential order as illustrated in Figure 1(a), or adjacent to one another as illustrated in 
Figure 1(b). The two fields represent images captured at different times. These 

25 interlaced frames represent the figures that are displayed on a suitable display device 

such as, for example, a television screen. 

To maintain the image quahty of a moving figure, an NTSC signal, for example, 
can only be displayed on an interlaced monitor such as a television screen or equivalent 
RGB screen. When images comprised of NTSC signals are displayed on progressive 

30 display devices, i.e. computer monitors, without processing, the frames that provide an 
NTSC image of a moving object such as, for example, the glass illustrated in Figure 2(a) 
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will appear on the progressive display devices as having jagged edges (or artifacts) as 
illustrated in Figure 2(b). 

SUMMARY OF THE INVENTION 

The present invention is directed to a video display system and associated 
5 processing method that is capable of removing artifacts from a video signal, resulting in a 
filtered video signal that is capable of being displayed on progressive display devices. 
The artifacts are removed from an input video signal in a frame by frame fashion. Frame 
processing is performed in one of two fashions: (1) based on the information contained in 
each individual frame or (2) by an interpretive process based on the processing performed 

10 on a preceding number of adjacent frames. In an exemplary embodiment, artifacts are 

removed from an input video signal by: (a) obtaining the current frame information from 
an input video signal; (b) detecting the current frame delimiter from the input video 
signal; (c) determining whether the current frame is within a predetermined time interval; 
(d) determining the type of processing to be performed within the time interval from a 

15 corresponding table; and (e) generating a video frame signal in response to the 

predetermined parameters contained in the table. 

In an alternate embodiment, artifacts are removed from an input video signal by: 
(a) separating a video image frame into its component fields; (b) determining which of 
the component fields is a first component field; (c) discarding the second component field 

20 of the video image frame; and (d) generating a combined video image frame signal based 

solely on the first component field. 

The aforementioned signal processing steps are performed by a larger digital 
video system comprising a navigation unit operative to isolate an input video signal 
present on a digital media element provided therein; and a video unit operative to process 

25 the isolated video signal such that the video signal can be displayed on a progressive 

display device, the video unit comprising a decoder for separating the video signal into a 
plurality of frames, each frame containing a series of fields; and a video display module 
operative to process the fields based on information contained within each of the plurality 
of frames. In an exemplary embodiment, the video display module fiirther includes a 

30 detection unit operative to determine the type of processing to be performed on the uiput 
video signal based on the fields. 
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An advantage of the present invention is that it provides the abiUty to view a 
conventional digital image on progressive display devices. 

Another advantage of the present invention is that it provides the abihty to 
process a conventional digital image during run time. 
5 Still another advantage of the present invention is that it is simple to implement. 

Yet still another advantage of the present invention is that it improves video 
signal processing efficiency. 

BRIEF DESCRIPTION OF THE DRAWINGS 

10 The aforementioned and related advantages and features of the present invention 

will become apparent upon review of the following detailed description of the invention, 
taken in conjunction with the accompanying drawings, where like numerals represent like 
elements, in which: 

Figures 1(a) -1(b) are schematic representations of the components of a video 

15 signal; 

Figure 2(a) is a schematic representation of an image provided on a conventional 
display device based on a conventional video signal; 

Figure 2(b) is a schematic representation of the image illustrated in Figure 2(a) as 
displayed on a progressive display device; 
20 Figure 3 is a schematic diagram of a video display system according to the present 

invention; 

Figure 4 is a block diagram of the detection and processing units of the video 
display module according to the present invention; 

Figure 5 is a flow chart of the operating steps performed by the video display 
25 module during initialization of the video display system; 

Figure 6 is a flow chart of the operating steps performed by the video display 
module during run time of the video display system; 

Figure 7 is a flow chart of the operating steps performed by the video display 
module during content based detection; 
30 Figure 8 is a flow chart of the operating steps performed by the video display 

module during bit-stream based detection; 

3 
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Figure 9 is an illustration of WEAVE processing as performed on a digital video 
frame signal by the video display module according to the present invention; 

Figures 10(a) - 10(c) illustrates BOB processing as performed on a digital video 
frame signal by the video display module according to the present invention; 
5 Figure 1 1 illustrates BOB processing as performed on a digital video frame signed 

by the video display module according to an alternate embodiment of the present 
invention; 

Figure 12 is a schematic representation of an image as displayed on a progressive 
display device based on the filtered video signal generated by the video display module 
10 of the present invention. 

DETAILED DESCRIPTION OF THE INVENTION 

The video display system of the present invention will now be described with 
reference to Figures 3-12. In an exemplary embodiment of the present invention, the 

15 digital video display system comprises a digital versatile disk (DVD) player 10, including 
a navigation imit 12 coupled to a video unit 14. The video unit 14 provides a filtered 
video signal to a progressive display device 20 on line 21. In a preferred embodiment, 
the progressive display device 20 is a computer monitor. The video imit 14 includes a 
decoder 15 and a video display module 18. The video display module 18 performs the 

20 detection and signal processing ftmctions of the present invention and provides the 
filtered video signal on line 21. 

The navigation unit 12 accepts a digital media element such as, for example, a 
digital versatile disk 1 1 and is capable of providing the audio information stored on the 
versatile disk 1 1 on a first data hne (AUDIO) the video information stored on the 

25 versatile disk 1 1 on a second data line (VIDEO), and any additional information stored 

on the versatile disk 1 1 on a third data line (ADDT'L). In operation, the navigation unit 
12 is also capable of providing the current playback position of the versatile disk 1 1 
being played by the DVD player 10 on line 22. 

The video information present on the VIDEO line is transferred to the video unit 

30 14 through the decoder 15. The decoder 15 is capable of separating the input video 

signal into a plurahty of frames that make-up the input video signal. The plurality of 

4 
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frames have the same structure as the frames illustrated in Figure 1(b). The video frames 
are then transferred to the video display module 18 for processing. 

The video display module 18 is comprised of a detection unit 16 (Figure 4) and a 
processing unit 17 (Figure 4). The detection unit 16 is capable of detecting the presence 
5 of a new video frame from the signal provided by the decoder 15 and to determine the 
type of processing (or filtering) that should be performed on such video frame. After 
determining the appropriate type of processing that needs to be performed on any given 
frame, such processing is then performed in the processing imit 17. hi operation, the 
processing unit 17 performs two types of filtering on the video frame: (1) WEAVE signal 

10 processing (Figure 9); or (2) BOB signal processing (Figure 10). The appropriately 
filtered video frame is then provided to the computer monitor 20 on line 21 . 

The operation of the DVD player 10 of the present invention will now be 
described with reference to Figures 5-11. Figure 5 is a flow chart of the operating steps 
performed by the video display module 1 8 of the present invention during initiahzation of 

15 the DVD player 10. The initiahzation routine illustrated in Figure 5 is performed every 
time a versatile disk 1 1 is inserted into the navigation unit 12. hi a first step 50 a Volume 
table is generated for the versatile disk being played. The Volume table is a database, or 
suitable look-up table, containing entries relating to the filtering that needs to be 
performed on the frames which comprise the images present on the versatile disk 11. 

20 Table 1 illustrates an exemplary Volume table. 



DVD Volume Title 


Title No. 


Chapter 


Start Time 


End Time 


Procession Decision 


INTERVIDEO 


1 


1 


Ta 


Tb 


BOB 


INTERVIDEO 


1 


2 


Tc 


Td 


WEAVE 



Table 1 

As shown, in Table 1, the contents of the Volume table are indicative of the type of 
25 filtering that must be performed on the various frames that comprise the video signal that 

is present on the versatile disk 1 1 . More specifically, the Volume table contains 
information on the title of the video being played, the frame number being currently 

5 
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played, the length of the frame being played and the type of filtering required to be 
performed on the frame during a given time interval. 

After the Volume table has been generated, in step 52 the DVD player 10 next 
detects the presence of an entry in the Volume table which corresponds to the information 
5 (i.e. movie title) stored on the versatile disk 1 1. If the Volume table contains an entry 

which matches the title of the versatile disk 1 1, the processing (filtering) information 
maintained in the memory of the processing unit 17 (Figure 4) is updated. If no match is 
detected, the particular entry in the Volume table is set to zero in step 54. 

After initiahzation has been completed, the DVD player 10 knows what type of 

10 filtering needs to be performed on the input video signal during run time and when such 
filtering is to be performed. The DVD player 10 then enters the run time (or playback) 
phase of operation. Figure 6 is a flowchart of the operating steps performed by the video 
display module 18 of the present invention during run time. At a first step 60, and at a 
predetermined time intervals during the playback of the versatile disk 11, the detection 

1 5 unit 16 (Figure 4) of the video display module 1 8 checks whether the user has selected a 

particular type of video processing to be performed on the current frame. If the user has 
made a selection, control is then transferred to the selected video processing module at 
step 61. After control has been transferred in step 61, where appropriate, processing 
(BOB or WEAVE ) are performed, as specified by user selection. 

20 If no user selection was made or auto detection was selected in step 60, a 

determination as to whether content based detection should be performed on the current 
frame is made in step 62. If content based detection is to be performed on the current 
frame, control is then transferred to the content based detection module in step 70. If 
content based detection is not to be performed on the current frame, control is then 

25 transferred to the bit-stream based detection module in step 80. The content based 

detection algorithm and bit-stream based detection algorithm will be described in greater 
detail below. 

As illustrated in Figure 7, when content based detection is to be performed on the 
current frame, the detection unit 16 of video display module 18 retrieves the current 
30 playback position of the versatile disk 1 1 from the navigation unit 12. Next, the current 
title, chapter and frame time of the video being played are stored in the variables title_c, 

6 
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chapter_c and time_c, respectively in step 71. The current title_c, chapter_c and time_c 
information is obtained from the navigation unit 12 approximately every 30 ms. Next, in 
step 72, a determination is made as to whether there is a match between title_c, chapter_c 
and time_c and the data present in the Volume table generated during initialization. If 
5 there is a title and chapter match and time_c is between a predetermined start 

(start_time_v) and end (endjime^v) time in step 74, then the type of processing to be 
performed on the current frame is that provided by the Volume table in step 76. 

Next, control is then transferred to the processing unit 17 (Figure 4) where the 
particular type of signal processing listed in the Volume table, either BOB processing or 

10 WEAVE processing, is performed on the current frame. For example, referring to Table 
1 provided above, by employing the content based detection algorithm of the present 
invention, the processing unit 17 will know that BOB processing is to be performed on 
the frame displayed during the Tb-Ta time period and that WEAVE processing is to be 
performed on the frame being displayed during the Td-Tc time period as shown on the 

15 timeline below. 

BEGIN BOB WEAVE END 



SIGNAL Ta Tb Tc SIGNAL 

20 

On the other hand, if no Volume table match is detected in step 72, control is then 
passed to the bit-stream detection algorithm in step 73 where bit-stream based detection 
is performed on the current frame. This content based detection scheme is very precise in 

25 that the particular type of video signal processing to be performed on a given frame is 

provided directly from the frame data contained within the Volume table. No additional 
calculations are required. In experiments performed by the inventors, processing of video 
frames using content based detection yielded images that have much better visual quahty 
than conventional video frame signals. 

30 Bit-stream based detection will now be described with reference to Figure 8. As 

illustrated in greater detail in Figure 8, when control is transferred to the bit-stream based 
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detection algorithm, the detection unit 16 of the video display module 18 retrieves the 
current frame information from the decoder unit 15. For each frame, an interlace 
indicator In is calculated in step 81 based on the following boolean expression: 
In = NOT ( (picture__structure = FRAME_PICTURE) AND progressive_frame ) 
5 where picture_structure is a variable obtained from the frame information contained on 
the versatile disk 1 1 and represents the structure of the current frame. More specifically, 
the picture__structure variable can have one of three values: FRAME_PICTURE, 
TOP_FIELD or BOTTOM_FIELD. Variables TOP_FIELD and BOTTOM_FIELD 
indicate which field of the current video frame is first, FRAME_PICTURE is a variable 

10 which indicates that the current frame is not separated into fields. Variable 

progressive_frame is obtained from the frame information contained on the versatile disk 
1 1 and is an indicator as to whether the current frame can be displayed on a progressive 
display device without any further processing. When progressive_frame has a value of 1 
(true), this indicates that the present frame is ahready in a proper format to be displayed 

15 on a progressive display device. If progressive_frame is zero (false), this indicates that 
some type of processing (either BOB or WEAVE) needs to be performed on the current 
frame. The relationship between In and the progressive_frame variable is represented 
graphically in Table 2 below. 



In 


progressive_frame 


picture_structure 


1 


0 




0 


1 


FRAME_PICTURE 



20 Table 2 

After In has been calculated in step 81, it is stored as the last entry in a first in first 
out (FIFO) memory in step 82, along with the calculated In values of the three 
immediately preceding frames. Next, in step 84, a decision is made using the four stored 
In values regarding what type of processing is to be performed on the current frame based 
25 on the following boolean condition: 

(In=TRUE) and (In-i=TRUE) AND (In-2=TRUE) AND (In-3=TRUE) 
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Thus, if In, In-i, In-2 andlN-3 are all 1 (TRUE), then control is transferred to processing 
unit 17 where BOB processing will be performed on the current frame in step 85. 

On the other hand, if any of the In values are a zero (false), then control will be 
transferred to the processing unit 17 where WEAVE processing will be performed on the 
current frame in step 86. In the bit-stream detection method described above, In is 
calculated for every frame, and the decision as to the type of processing to be performed 
on the current frame is always determined by comparing the current In with the interlace 
indicator values of the three immediately preceding frames (In-u In-2, and In-s). 

The signal processing that is performed by the processing unit 17 of the present 
invention will now be described with reference to Figures 9 and 10. Figure 9 is an 
illustration of WEAVE processing that is performed on a video frame signal. As shown 
in greater detail in Figure 9, the current frame to be processed is separated into two fields: 
a top field, which in a preferred embodiment is represented by field lines 0, 2, 4, 6. . .N-1, 
and a bottom field represented by field lines 1,3,5,7,. . .N. hi WEAVE processing, 
artifacts are removed from the current frame by taking the out of bound values (present in 
the pixels that comprise the field lines) and placing them within the proper field line. 
More specifically, as shown in Figure 9, WEAVE processing takes the adjacent fields 
and concatenates them into a single video frame containing field fines 0-N. 

Figure 10 illustrates BOB processing that is performed on a current frame signal 
by the processing unit 17. In BOB processing, the current frame is first separated into its 
two respective fields (Fig. 10(a)). Next, a determination is made as to which of the 
respective fields occurs first. To determine whether the bottom field is the first frame 
field, the following boolean condition must be satisfied: 

bBottomFirst = ((picture_structure = FRAME_^PICTURE) AND (NOT top„field_first)) 
OR (picture^structure - BOTTOM_FIELD ) 

Thus, if variable picture_structure is set to BOTTOM FIELD, then bBottomFirst is true. 
Also, if picture_structure is set to FRAME^PICTURE, indicating the current frame is not 
separated into fields, and top_field_first is not set, then bBottomFirst is also true. 
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If bBottomFirst is trae, then the bottom field is used to construct the resulting video 
frame. Otherwise, the top field is used to construct the resulting video frame. 

As illustrated by the boolean pseudocode above, BOB processing first determines 
which of the two frame fields is first. That first field is then used to generate the resulting 
5 video frame as illustrated in Figures 10(b) and 10(c). Figure 10(b) represents the 

situation where the first field is the top field represented by field lines 0, 2, 4, 6,. . .N-1. 
As shown in Figure 10(b), when the top field is the first field, the bottom field is 
discarded and the resulting video frame is constructed as follows: the first frame line is 
field line 0, The second frame line contains the average of the pixel values present in 

10 field line 0 and field line 2, The third frame line is field hne 2. The fourth frame line 
contains the average of the pixel values present field line 2 and field hne 4. The fifth 
frame hne is field line 4. The sixth field line contains the average of the pixel values 
present in field line 4 and field line 6. The remaining field lines are generated as 
discussed above until the video frame is completed by having the last frame hne be the 

15 last (or bottom field line) of the first selected frame. Thus, resulting frame lines 1,3,5, . . . 
N-1 contain values representative of the average pixel values contained in adjacent frame 
lines. 

Figure 10(c) illustrates the resulting frame when the bottom field is the first field. 
The resulting frame is constructed as follows: the first and second frame lines are 

20 represented by field line 1 . The third frame line is a field line containing a value that is 

the average of the pixel values present in the second frame line (field line 1) and field line 
3. Frame line 4 is represented by field line 3. Frame line 5 contains the average of the 
pixel values present in field line 3 and field line 5. The generation of the calculated field 
fines continues through the last frame line which is represented by original field line N. 

25 Thus, when the bottom field is the first field, the first two field lines of the resulting video 

frame are represented by the top field hne of the original video frame. 

In an alternate embodiment of the present invention, the resulting video frame 
generated as a result of BOB processing can be represented as an n-tap low pass filter as 
illustrated in Figure 1 1 , where the pixel values of the intermediary frame lines Xn are 

30 represented as follows: 

10 

SFO 4010706v3 



XN=(C3Xn-3 + ClXn-l + CiXn+l + C3Xn+3)/(Cl + C3 + C3 + Ci) 

where C3 and ci are constants which are used to provide a weighted average for the pixels 
represented by Xn.3, Xt^.i, Xn+i and X^+s- In experiments performed by the inventors, it 
5 was determined that ci=3 and C3=l provides the optimum values for the resulting video 

frame. 

Upon completion of either the BOB or WEAVE processing, the artifacts from 
each frame of the video signal will have been removed, thereby resulting in an image 
being displayed on a progressive display device, such as a computer monitor, having no 

10 jagged edges as illustrated in Figure 12. 

The foregoing detailed description of the invention has been provided for the 
purposes of illustration and description. Although an exemplary embodiment of the 
present invention has been described in detail herein with reference to the accompanying 
drawings, it is to be understood that the invention is not limited to the precise 

1 5 embodiment disclosed, and that various changes and modifications to the invention are 

possible in Ught of the above teaching. Accordingly, the scope of the present invention is 
to be defined by the claims appended hereto. 
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CLAIMS 

WHAT IS CLAIMED IS: 

1 . A digital video display device, comprising: 

a navigation unit operative to isolate an input video signal; 
5 a video unit operative to process said input video signal such that said 

input video signal can be displayed on a progressive display device, said video unit 
comprising: 

a decoder operative to separate said input video signal into a 
plurality of frames, each frame containing a series of fields; and 
10 a video display module comprising a detection unit operative to 

determine the type of processing to be performed on said input video signal based on 
information contained within each of said plurahty of frames. 



2. The system of Claim 1 , wherein said video display module ftirther 
1 5 includes a processing unit operative to provide a filtered digital video frame signal based 

on said fields. 



3. The system of Claim 1 , wherein said detection unit is operative to 
determine the type of processing to be performed on a video frame signal based on 

20 particular field data contained within said video frame signal. 

4. The system of Claim 1, wherein said detection unit is operative to 
determine the type of processing to be performed on a video frame signal based on the 
field data of a predetermined number of prior video frames and said video frame signal. 

25 

5. The system of Claim 4, wherein said predetermined number of prior video 
frames is three. 
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6. The system of Claim 2, wherein said processing unit further comprises a 
first processing module operative to provide a digital video frame that is a concatenation 
of fields of an input data frame, and a second processing module operative to provide a 
digital video frame containing field segments having values based on adjacent field 
segments. 

7. The system of Claim 3, wherein said particular field data is stored in a 
table, said table containing the type of processing to be performed on said video frame 
signal 

8. A digital video display system, comprising: 

a navigation module operative to isolate an input video signal present in a 
digital medium; 

a decoder operative to separate said input video signal into a plurality of 

video frames; 

a detection module operative to detect the type of processing to be 
performed on said video frame, said detection module including a table which provides 
the type of processing to be performed on said video frame in response to the current 
video frame position; and 

a processing module operative to provide a filtered video frame in 
response to information contained in said table, wherein said filtered video frame is 
capable of being displayed on a progressive display device. 

9. The system of Claim 8, wherein said processing module fiirther comprises 
a first module operative to provide a video frame signal that is a concatenation of the 
fields of an input video frame, and a second module operative to provide a video frame 
signal containing field segments having values based on the values of adjacent field 
segments. 
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1 0. The system of Claim 8, wherein said detection module is operative to 
determine the type of processing to be performed on said video frame based on field data 
of a predetermined number of prior video frames and said video frame, 

1 1 . The system of Claim 10, wherein the predetermined number of prior video 
frames is three. 

12. A video signal processing method, comprising the steps of: 

(a) obtaining current video information from an input video signal; 

(b) detecting the current frame delimiter from said input video signal; 

(c) determining whether said current frame is within a predetermined 

time interval; 



in said data table. 

1 3 . The processing method of Claim 1 2, wherein said predetermined 
parameters are frame dependent. 

14. A method of processing a video signal to remove artifacts, comprising the 



(d) determining the type of processing to be performed on said current 
frame from a corresponding data table; 

(e) generating a video frame in response to predetermined parameters 



steps of: 



(a) 
(b) 



separating a video image frame into its component fields; 
determining which of said component fields is the first component 



field; 



(c) 



discarding the second component field of said video image frame; 



and 




generating a combined video image frame signal based only on 
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15. The method of Claim 14, wherein step (d) comprises the steps of: 

(dl) separating said first component field into alternating pixel lines; 
(62) generating a pixel line having a value comprising the average of 
said alternating pixel lines; and 

(d3) providing said generated pixel line between said alternating pixel 

lines. 
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SYSTEM AND METHOD FOR DEINTERLACING A VIDEO SIGNAL FOR 
DISPLAY ON PROGRESSIVE DISPLAY DEVICES 



ABSTRACT OF THE DISCLOSURE 

5 A system and method for processing a video signal to make the corresponding 

image suitable for display on a progressive display device, i.e., a computer monitor, is 
disclosed. The processing system includes a video display module v^hich is capable of 
processing an image frame based on the content of the frame information itself, or the 
values of the pixels that comprise the frame. 

10 
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As below named inventors, we hereby declare that: 

Our residence, post office address and citizenship are as stated below next to our name. 

We believe we are an original, first and joint inventor of the subject matter which is claimed and 
for which a patent is sought on the invention entitled: 

SYSTEM AND METHOD FOR DEINTERLACING A VIDEO SIGNAL FOR DISPLAY ON 

PROGRESSIVE DISPLAY DEVICES 

the specification of which (check one) 

(X) is attached hereto. 

( ) was filed by an authorized person on my behalf on 

as Application Serial No. 

and was amended on . 

(if applicable) 

We hereby state that we have reviewed and understand the contents of the above-identified 
specification, including the claims as amended by any amendment referred to above. 
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application in accordance with Title 37, Code of Federal Regulations, §1, 56(a). 

We hereby claim foreign priority benefits under Title 35, United States Code, §119 of any 
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invention filed by us or our legal representatives or assigns and having a filing date before that of 
the application on which priority is claimed. 

Priority 
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We hereby claim the benefit under Title 35, United States Code, §120 of any United States 
application(s) listed below and, insofar as the subject matter of each of the claims of this 
application is not disclosed in the prior United States application in the manner provided by the 
first paragraph of Title 35, United States Code, §112, we acknowledge the duty to disclose 
material information as defined in Title 37, Code of Federal Regulations, §1, 56(a) which 
occurred between the filing date of the prior application and the national or PCT international 
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